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ABSTRACT 

Project Compugraf ia. LEP (Limited English Proficiency) 
was designed to provide supplementary services and materials to 
existing bilingual special education programs in nine elementary 
schools in the Bronx (New York). The 471 project students were mildly 
to moderately disabled children from low-income Spanish-speaking 
families. The components of the program included instruction in 
English as a Second Language (ESL) , Native Language Arts (NLA), 
computer-based skills, and career education. The project involved the 
parents in order to help them understand bilingual and special 
education procedures, and parents were also offered ESL instruction. 
The project also planned a broad range of staff development 
activities which focused on techniques of instruction, new 
curriculum, and utilization of computers as teaching aids. This 
1991-92 evaluation report describes staffing, implementation, and 
outcomes. The project met its objectives for career education, 
curriculum development, staff development, and computer skills, but 
failed to meet objectives for ESL, NLA, and parent involvement. A 
brief case history concludes the report, and appendixes describe data 
collection and analysis procedures and list instructional materials 
used in the project. (JDD) 
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FOREWORD 



The body of this report is preceded by an Extract which presents an overview of salient points of 
the project: funding cycle; enrollment figures; background of students served; admission criteria; and 
programming features, strengths, and limitations, including the outcome of all objectives. The extract also 
presents the conclusions drawn by the Office of Research, Evaluation, and Assessment (OREA) about the 
program and its recommendations for program iniprovenieni. 

The extract is followed by the body of the report, titled Program Assessment , This includes such 
information as staffing, program implementation, and outcome and implementation objectives. 
Instructional objectives are presented first, followed by noninstructional objectives. The report then 
addresses those aspects of programming mandated by Title VII regulations that do not have specifically 
stated objectives. This may be information on attendance and dropout rate, grade retention, 
mainstreaniing, referrals out of the program to meet special needs of the students, and withdrawals. A 
case history concludes the report. 

Data for this profile were collected and analyzed using a variety of procedures, which are 
described in Appendix A following the text. 
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EXTRACT 

FUNDING CYCLE: Year 5 of 5 



School District 


Grade Levels 


Enrollment* 


9 


2-5 


45 


10 


2-4 


52 


9 


2-6 


70 


8 


2-6 


122 


12 


2-3 


57 


11 


2-4 


29 


11 


2-4 


7 


7 


3-6 


33 


7 


3-6 


29 


12 


3-5 


27 



♦iTie project enrolled 471 students (69 less than in the previous year). Male students numbered 322, female 147; 
gender not stated for 2. 



STUDENT BACKGROUND 
Native Language Number of Students 

Spanish 471 



Countries of Origin 

Unites States 
Puerto Rico 
Dominican Republic 
Honduras 
Mexico 
Ecuador 
Nicaragua 
Panama 
Spain 
Venezuela 
Unreported 

Median Years of Education in Native Country: 2.0; in the United States: 6.0 
Percentage of Students Eli p ^ible for Fr ee Lunch Program: 99.6 



Number of Students 

293 
134 
25 

6 

3 

2 

2 

1 

1 

1 

3 



ADMISSION CRITERIA 

Admission criteria included special education designation and a score at or below the 40lh percentile on 
the Language Assessment Battery (LAB) indicating limited English proficiency. 
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PROGRAMMING 



Design Features 

Project Compugrafia.LEP was designed to provide supplementary services and materials to existing 
bilingual special education programs in nine elementary schools in the Bronx. The project students were mildly to 
moderately disabled and were in Modified Instructional Services (MIS) I, II, III, or IV. The components of the 
program included instruction in English as a Second Language (E.S.L.), Native Language Arts (N.L.A.), 
computer-based skills, and career education. The design included involving the parents in order to help them 
understand bilingual and special education policies and procedures. Parents also were offered E.S.L. for the 
purpose of improving their own English proficiency. The project also planned a broad range of staff development 
activities focused on techniques of instruction, new curriculum, and the utilization of computers as teaching aids. 

Capacity building. By the end of the year under review the project reduced Other Than Personnel 
Services (O.T.P.S.) support by Title VII by more than 80 percent. 



Strengths and Limitations 

The chief strengths of the program were the class intervention activities, staff development, and 
curriculum development activities. Program limitations lay in its inability to meet its objectives for E.S.L., N.LA., 
and parent involvement. 

CONCLUSIONS AND RECOMMENDATION 

Compugrafia.LEP was fully implemented. As it had done last year, it met its objectives for career 
education and curriculum and staff development. Although it failed to do so last year, Compugrafia.LEP met its 
objective for computer skills. Similar to last year, it did not meet objectives for E.S.L. or N.L.A. While it had 
met its objectives for parent involvement last year, it failed to do so this year. 

This was the last year of the project, therefore no recommendations are being made by OREA. 
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STAFFING 

Title VII Staff (Total 2) 

Yiile Degree Language Competencies 

Teacher Training Coordinator M.A. Spanish 
Paraprofessional High Schools Spanish 

The teacher training coordinator fulfilled the functions of a resource specialist. 

Other Staff Working With Project Students (Total 29) 

The project director held a doctorate and was proficient in Spanish, 

Language Competencies and Teaching/ 
Titles Degrees Certification Communicative Proficiencies (TP/CP)* 

Project Director 1 Ph.D. 1 Bil. Special Ed. 28 Spanish TP 21, CP 7 

Teachers 28 M.A. 22 

B.A. 6 

All staff were certified in the area in which they worked. 

IMPLEMENTATIONS AND OUTCOMES (Objectives prefaced by •) 
English as a Second Language (E.S.L.) 

E.S.L. was offered five periods a week on the beginning, intermediate, and advanced levels. Project 
instructors employed the whole language, language experience, natural, and total physical response approaches as 
well as art and music. 

See Appendix B for list of instructional materials. 

• By the conclusion of the fifth project year, all students will have demonstrated a significant increase 
in percentile score in their performance on the Language Assessment Battery (LAB)-English 
administered on a pre- and posttest basis. 

Evaluation Instrument: Language Assessment Battery (LAB)** 



*Teaching ProCciency (TP): Competent to teach in this language. 
Communicative Proficiency (CP): Conversational capability only. 



**OREA used a gap reduction design to evaluate the effect of supplementary instruction on project students' 
performance on the LAB. Since all LEP students in New York City are entitled to such instruction, no valid 
comparison group exists among these students, and OREA used instead the group on which the LAB was 
nornied. Test scores are reported in Normal Curve Equivalents (N.C.E.s), which are normalized standard scores 
with a mean of 50 and a standard deviation of 21.06. It is assumed that the norm group has a zero gain in 
N.CE.S in the absence of supplementary instruction and that participating students' gains are attributable to 
project services. 
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Preiesi: May 1991; posiiesl: May 1992. 

Number of students for whom pre- and posiiest data were reported: 312 
Percent of students with pretesi/posttest gains: 28.8 
Mean gain: -0.15 N.C.E.s (s.d.=:11.8) 
Project did not meet E.S.L. objective* 

Native Language Arts fN,L.A.) 

N.L.A. was offered five periods weekly on the beginning, intermediate, and advanced levels. All the 
students lacked literacy skills in their native language when they entered the program. Of those who had entered 
the project in its first year, none remained in it-most of these students had graduated. The director estimated 
that 70 percent of those who entered in the project's second year and remained in the program had attained 
Uteracy in Spanish. For students who had entered in the third and fourth year, estimates of the proportion 
attaining native language Uteracy were 40 percent and 10 percent respectively. 

For a list of instructional materials, see Appendix B. 



• By the conclusion of the fifth project year, all students will have demonstrated a significant increase 
in percentile score in their performance on the Language Assessment Battery (LAB)-Spanish 
administered on a pre-posttest basis. 

Evaluation Instrument: Pretest, Reading Spanish subtest of LAB May 1991; posttest, Examen de Lectura en 
Espanol (ELE), May 1992.» 

Number of students for whom pre- and posttest data were reported: 150 



Percent of students with pretest/posttest gains: 353 
Mean gain: -6.1 N^CE.s (s.d,=:18.9) 
Project did not meet N.L.A. objective. 



Content Area Subjects 

The project provided a bilingual/bicultural teaching environment and cultural activities within the content- 
based program of instruction of the special education curriculum. Learning was facilitated by relating materials to 
children's personal experiences. Subjects were taught bilingually or with an E.S.L. methodology, depending on 
the level of ability of each student. For Bilingual Instruction Sen/ice (BIS) I students: the [.^ns were conducted 
in Spanish, and for BIS II students the lessons were conducted in both Spanish and English. 

See Appendix B for a list of instructional materials. 

The program did not propose an objective for content area subjects. 



•Details for the evaluation design using the spring 1991 Spanish LAB administration as a pretest and the spring 
1992 ELE administration as a posttest will be forthcoming. 

I iJ 
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Conipuier-Based Skills 



See Appendix B for a list of insiruclional materials. 

• By the conclusion of the fifth project year, all students will have demonstrated improved ability of six 
new skills for each year of project participation in computer-supported writing instruction in any 
combination of the areas of keyboarding, text editing, and word processing skills. 

Evaluation Indicator: teacher report of skills mastered. 

Number of students for whom skills were reported: 318 

Percentage of students mastering six or more skills: 100.0 

Project met computer-based skills objective. 

Career Education 

• By the conclusion of the fifth project year, all students will have demonstrated improved ability of six 
new skills for each year of project participation in career education instruction in any combination of 
the areas of career exploration, work readiness, and work study skills. 

Evaluation Indicator: teacher report of skills mastered. 

Number of students for whom skills were reported: 289 

Percentage of students mastering six or more skills: 100.0 

Project met career education objective. 

Attendance 

The program did not propose an objective for attendance. Participating students' attendance rates for the 
year under review and the previous year, however, are presented below: 

AT TENDANCE RATES 



School 1991-92 Rates 1990-91 Rates Difference 

P.S. 4 91.6 83.8 + 7.8 

p.S. 32 88.8 77.4 +11.4 

P.S. 42 90.8 88.2 + 2.6 

p.S. 60 90.0 87.0 +3.0 

P,S. 66 83.1 90.6 -7.5 

p.S. 89 91.4 94.3 -2.9 

P.S. 9^ N/A 87.9 

P.S. 156 96.3 93.6 +2.7 

P.S. 157 89.8 87.4 +2.4 

P.S. 198 89.1 88.0 +1.1 



In the schools for which there were data (all but one school), attendance rates increased at seven schools 
(77.8 percent) and decreased at two (22.2 percent). 
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Grade Retention 



Two project students (0.35 percent) were retained in grade. Last year, four project students (0.7 percent) 
were retained in grade. 

Mainstreaming 

The mainstreaming of project students into English-only classes depended on School-based Support Team 
(S.B.ST.) referrals, LAB scores above the 40th percentile, and demonstrated competence in reading, writing, and 
speaking. Because of the transient nature of the community, few students were in the program long enough to be 
entirely mainstreamed. 

In the year under review, approximately 5 percent of participants were mainstreamed. Many more 
students were partially mainstreamed into general education classes, which met five periods per week. Last year 
one student (0.2 percent of participants) was mainstreamed. 

TTiere were no formal follow-up proc' 'ures for mainstreamed students, but those who remained in the 
school were in contact with the guidance counselor. 

Staff Development 

Each month, the project management team developed agendas, supporting materials, lists of guest 
speakers, and outlines for the purpose of implementing staff development workshops. Folders for each workshop 
were prepared for each participant. The resource specialist conducted on-site sessions, using the same agenda for 
teachers who missed the workshops. In addition, 16 hours of training was made available to the project teachers 
in a summer institute, 

• By the conclusion of the fifth project year, all targeted classroom teachers will have participated in 
staff development sessions on the development of instructional areas identified by this project using 
bilingual special education instruction approaches. Academic programs will emphasize mastery of 
English. 

All 28 classroom teachers of program students participated in the staff development sessions as propos.;d. 
Project met stafT development objective. 
Curriculum Development 

• By the conclusion of the fifth project year, the Title VII resource specialist will have developed 
subject matter oriented instructional units and model lesson plans for teaching keyboarding, text 
editing, and word processing skills. These curriculum materials will be integrated into the E,S.L, 
instructional component, 

• By the conclusion of the fifth project year, the Title VII resource speciahst will have developed 
subject matter oriented instructional units and model lesson plans for teaching career exploration, 
work readiness, and work study skills. These curriculum materials will be integrated into the major 
content area instructional component. 

The Title VU resource spw*cialist developed inslruciional uiiiis and model Icsscmi plans tor ihc designated 
subjects. The project integrated these materials into the E.S.L. or content areas component as proposed. 



Project met curriculum development objectives. 



Parental Involvemen t 



• By the conclusion of the fifth project year, all parents of program students will have attended parent 
involvement sessions in the areas of bilingual education policies and procedures, and special 
education policies and procedures. 

Over 360 project parents (approximately 75 percent) attended parent involvement sessions that dealt with 
the policies and procedures of bilingual education and special education. 

Project did not meet objective for 100 percent parental involvement. 



• By the conclusion of the fifth project year, at least 50 percent of the parents of program students will 
have participated in E.S.L. training sessions for the purpose of improving their own English language 
proficiency. 

Over the course of the project 125 (approximately 25 percent) of the parents attended E.S.L. workshops. 
Project did not meet parental involvement objective for E.S.L.-training participation. 



CASH HISTORY 

1. was a bilingual student in a project class (Mis I, Bis II program). Her academic performance was poor. 
She improved greatly over the course of the term and did well academically and socially. She was mainstreamed 
in mathematics and by the end of the third marking period she was on the schoofs High Honor Roll with an 85 
percent average. She was recommended for mainstreaming into general education. 
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APPENDIX A 



DATA COLLECTION AND ANALYSIS 



COLLECnON 

OREA evaluation consultants visit sites and interview key personnel. The project director gathers data 
and, with the consuhant, completes forms (as shown below) as necessary. 

Student Data Form 

Tills one-page form is filled out by staff for each participating and mainstreamed student. OREA gathers 
data fiom this form on backgrounds, demographics, academic outcomes, attendance, referrals, and exit from the 
program. 

Project Director's Questionnaire 

The Project Director's Questionnaire includes questions on staff qualifications, program implementation, 
periods of instruction, and instructional materials and techniques. 

Project Director's Interview 

The interview gathers information on program and student or staff characteristics not supplied by the 
Project Director's Questionnaire. The interview also allows project staff to offer qualitative data or amplify 
responses to the questionnaire. 

Citywide Test Scores 

OREA retrieves scores centrally from the Language Assessment Battery (LAB) and other citywide tests. 
For evaluation purposes, these test scores are reported in Normal Curve Equivalents (N.C.E.s), N.C.E.S are 
normalized standard scores with a mean of 50 and a standard deviation (s.d.) of 2L06. They constitute an equal- 
interval scale in which the distance is the same between any two adjacent scores. A gain of 5 N.C.E.s is the same 
whether it is at the lower or the higher end of the scale. N.CE.s can be used in arithmetic computations to 
indicate group progress. (Percentile scales, although more familiar to many, are unsuitable for such computations 
since they are not equal-interval.) 

Likert-Tvpe Surveys 

Likert-type surveys, in which respondents mark their opinions on a scale from one to five, are used in a 
variety of ways. They examine student attitudes (i.e., toward school and career, native language use, and native 
and mainstream cuhures). They also assess staff and parent attitude and reactions to workshops and other 
activities. 



ANALYSIS 

Gap Reduction Evaluation Design 

OREA uses a gap reduction design for measuring changes in standardized tests. Since no appropriate 
non-project comparison group is available in New York City, where all students of limited English proficiency 
(LEP) are eniiiled to receive supplementary services, OREA compares the progress of participating students with 
that of the group on which the test was normed. It is assumed that the norm group would show a zero gain in 
the absence of instruction, and gains made by project students could be attributed to project services. Scores are 
reported in Normal Curve Equivalents (N.C.E.s), which are normalized standard scores with a mean of 50 and a 
standard deviation of 2L06. (See "Citywid^^ Test Scores" above.) 

To test whether pre/pcsttest gains are greater than could be expected by chance alone, OREA uses a r- 
test. To test whether a difference between two proportions (e.g., program and mainstream attendance rates) is 
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greater than could be expected by chanco, OREA uses a z-icst and reports the differences between the two 
proportions. The level of significance is set at .05 for all tests. 



Techniques For Minimizing Frror 

Tlie evaluation procedures minimize error by providing for proper administration of evaluation 
instruments through a combination of testing at 12-month intervals, appropriate analysis procedures 
and reporting. 

Instruments of measurement include the LAB (see above), the Degrees of Reading Power (D.R,P.) test, 
the Metropolitan Achievement Test-Mathematics (MAT-Math), El Exanien de Lectura en Espanol (ELE), 
Likert-type scales (see above), and project-developed tests. Except for Likert scales and project-developed tests, 
these instruments are scored on a citywide basis at the Scan Center of the New York City Public Schools. 



APPENDIX B 
INSTRUCTIONAL MATERIAI^ 



Software Programs 

Magic Slate II 

I Can Write 1 

Be A Writer 

Write With Me 

Write A Story 

Touch WLodow 

Touch ABd Write 

Language Experience Recorder 

Webster's Spell Checker 

Super Print 



E-S-L. 

Magnetic Way Into Learning 

Vox Everyday Spanish/English Dictionary 

A Writing Boole English In Everyday Life 

Short Stories 

Folk Tales 



N.L.A. 

Classics in Spanish 



Science 

nie World of Machines 
You And Your Body 
Sports And Entertainment 
What People Do 
Land Travel 
Ships And Boats 
Outer Space 
Index 
Flying 

People of Long Ago 
The Sea 
The Earth 

Cold Blooded Aniniak 
People And Customs 
Tlie Prehistoric World 
Warm-Blooded Animals 
Getting To Know 71 le Body 
Into Life Systems 
Readings In Natural 

Tite Bilingual Special Education Director 



